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ABSTRACT 



This paper discusses the author's personal experiences in 
developing and implementing a problem- based college mathematics course for 
liberal arts majors. This project was initiated in response to the 
realization that most students are dependent on "patterning" learning 
algorithms and have no expectation that self- initiated thinking is a 
characteristic of learning. The problem-based version of college mathematics 
presented here uses no required text; instead a packet of activities and 
project assignments accompanies material designed to add structure to the 
course. The paper addresses concerns about increased faculty workload in 
teaching for critical thinking and the additional time required for formative 
assessment. Using examples from the author's own experience in the classroom, 
it compares advantages and disadvantages of instructor-graded formative 
assessment with the suggested self -grading technique. The latter allows the 
instructor: (1) to see the learner's initial response, (2) to see what 
information the learner has gained from the discussion session, (3) to 
measure the learner's level of comprehension, and (4) to review only one set 
of papers in order to make small adjustments in the learner's understanding. 

A graphing activity and a self-assessment rubric are appended. (CH) 
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This paper is edited from the dialog of a presentation made to the Assessment 2000 conference of 
the American Association for Higher Education in Charlotte, NC, in June 2000. 

Abstract. Experience indicates that a major impediment to problem-based learning in 
mathematics is the excessive time one must spend in formative assessment activities. A 
technique employed to be more efficient in formative assessment of critical thinking in 
problem-based learning can significantly decrease the time and work demand on the 
instructor, while providing timely and authentic feedback to the learner. 

As educators we continually ask ourselves 

• How do we know our students are learning? 

• How do we know they are thinking critically? 

• How can we follow their patterns of thought? 

But more important are the questions: 

• How do THEY know they are learning? 

• How do THEY know they are thinking critically? 

• How can THEY reflect on their patterns of thought? 

Background. For nearly a quarter century I taught, discussed, assigned, assessed, 
graded - in some order or another. I hoped and expected that students would read and 
reflect on all those comments and thought-provoking questions I so meticulously wrote 
on their homework and tests. As I learned to give more authentic assignments, I realized 
that much of what we (I) had taken for learning was really patterning. If I can be allowed 
to oversimplify the best student’s expectation it would be, “Give me an example of how 
to think and do and I’ll think and do like you.” Students seldom evidenced their own 
ideas except during our Socratic questioning sessions - sessions in which formative peer- 
and self-assessment were part and parcel. 

In the years ‘91 -’93 I had two sets of experiences that changed the way I teach. First 
I tried piloting a middle grades statistics book in a semester-long course for eighth 
graders. Tfie only way I found to reach these students was through active learning and 
projects. Only later did I learn to call it problem-based learning (PBL). These students 
won the American Statistical Association’s national project competition. 

The second experience was teaching in a three-year program called the Partnership 
for Excellence in which we modeled progressive techniques for in-service teachers. We 
attempted activity-based learning, guided discovery, cooperative learning - every 
promising technique we could find or think up... and we used technology wherever 
possible. What seemed to work best were the activity-based strategies. 

Inforrned by these two experiences, some of us on the mathematics faculty at the 
University of South Carolina Spartanburg (USCS) fashioned a problem-based version of 
our College Mathematics course for liberal arts majors. We began teaching the PBL 
course in 1995. 
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The problem. Our work began as a response to the realization that most of the 
students entering our math classes were and are products of pedagogical styles that 
depend on learning algorithms, i.e. patterning, in order to be successful. (Ulmer, 1994) 
They bring with them no expectation that self-initiated thinking should be a characteristic 
of learning. There may be several reasons for this, including 

• Textbook dependence. One finding of the Third International Mathematics and 
Science Study was the inclination of US grade school teachers to spend 
disproportionate class time using textbooks compared to such countries as Japan 
and Germany. Mathematics instruction in those countries was found to be more 
successful than in US schools.(Peak, 1996) 

• Out-of-context instruction. Mathematics instruction has, for some decades, been 
governed by a curriculum in which topics were included on the basis of their 
consistency with other topics. Applicability, a criterion deemed important by 
most students, has seldom been a consideration for those writing high school and 
college math books. (When have you factored a quadratic polynomial, 
rationalized a denominator, or used the FOIL method as part of solving a real 
problem? Problems I encountered in my earlier work as a laboratory statistician 
and in more recent work as an operations research and mathematics consultant 
bore little resemblance to those in the textbooks fi-om which I taught.) 

• Repeated curriculum. Since the seventh grade textbook had the same topics as the 
eighth grade textbook, which was much like the ninth grade textbook... There is 
the pattern again! 

• ...and many other reasons you may be able to articulate. 

So the problem-based version of College Mathematics at USCS uses no required 
textbook. Instead, a packet of activities and project assignments accompanies a forty- 
two-page booklet designed to add structure to the course. The booklet contains too few 
textbook-^le problems to support the feculty member who wishes to spend class time in 
drill, practice and patterning. Fewer problems are worked than in the text-based version 
of the course, but, as other educators using active learning and PEL have found, "students 
appear to emerge with a greater store of usable knowledge." (Moore, 1997) Our in- 
course anc| subsequent performance assessment data supports that statement. Students 
succeed at a much higher rate (median = 75%) in the PEL version than in the text-based 
version (median ~ 56%) and those who take statistics the next semester succeed there at a 
higher rate. More detailed data can be found on the web as a PDF-formatted Imk fi’om the 
course web page: http://wvvw.uscs.edu/~mulmer/PEI_Index.shtml 



Only about half the mathematics faculty members at USCS have bought into the idea 
of PEL. They have reasons: 

• Some do not like the prospect of abandoning texts. Our department has several 
very well respected textbook authors. 

• Others do not wish to, or can't, give up control of the order, methods and styles of 
learning to the extent necessary for PEL to work. Eut most of all, 

• PEL presupposes teaching for critical thinking, and so, requires a great deal of 
formative assessment. And that means a lot of time and work! 

It is this last bullet that I address in that which follows. 



Critical Thinking and Formative Assessment: Problem-based instruction requires 
the learner to rely on his or her own thinking (not patterning) in order to begin solutions 
to problems. The problems themselves call for thinking in order to complete activities 
and write associated reports. This allows us as instructors to teach for critical thinking, 
which we might loosely describe as reflective thinking, or thinking about ones own 
thinking in order to improve the quality of that thinking. Early formative assessment 
activities serve to acclimate the learner to this need for critical thinking. 

As an example of my own development toward teaching for critical thmking, and the 
hurdles I encountered, consider one small topic from business calculus; that of 
distinguishing between the Absolute Rate of Change and the Relative Rate of Change. In 
days gone by, I might have asked students to distinguish between these concepts by 
stating the definitions. Some students, perhaps 30%, would succeed. Then I might have 
given a problem where they had to use the definitions to compute absolute and relative 
growth of some function for a given change in the independent variable (say, time). A 
few more, perhaps 40%, would succeed. Then, as benefits of contextual learning became 
more obvious, I actually gave the following question; 

"Would the Absolute Growth Rate or the Relative Growth Rate be more important to 
someone who wants to buy stocks?" 

To my delight, HALF THE CLASS got it right!! But that delight lasted about as long 
as it took you, the reader, to recognize that a higher success rate than 50% was needed on 
a two-response question to indicate that any learning was taking place! 

So two years ago, when I got a chance to teach the course again, I began to use 
writing as a vehicle for promoting critical thinking. I gave the following assignment; 

"In one-half page or less, explain why the Absolute Growth Rate or the Relative 
Growth Rate (pick one) would be more important to someone who wants to buy stocks." 

Realizing that for assessment to be formative, it must be timely, I graded and 
returned e^ch submission with comments and tried to incorporate a consideration of 
common mistakes into a Socratic session. It was extremely time consuming. But even 
more frustrating was the realization that it was I - not the intended learners - who was 
thinking critically about their work. The students simply stashed my well-chosen 
comments in a backpack and left for history or psychology class. 

Since then I have used the self-grading technique as follows; 

• Give an assignment requiring a short well-thought-out written response to a 
question. I cedi it a "ticket", indicating that it must be completed for admission to 
the ne^ class. 

• Once in class, have students put away all books, papers, pencils, pens, etc. - 
except for their responses to the assignment. Hand out colored pencils for 
students to use for corrections and modifications to their work. 

• Solicit discussion from students about their perspectives on the assignment. Use 
Socratic techniques if necessary to steer the conversation. Ask all students to 
correct or improve their own responses as they evaluate the oral responses of their 
peers. Require additions or corrections to be made with the colored pencil. 
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• Once discussion has revealed correct or reasonable responses, provide a rubric 
overhead by which the student can assign his or her own grade. Take up the 
assignment. 

• Before next class, review the students' responses and self-reported grade for 
accuracy and for adherence to the rubric, and make necessary adjustments in a 
third color of ink. Record scores. 

Attached below are an example activity and its corresponding rubric. Some additional 
activities are found on the course web site given above. 

Summary of Advantages. Using instructor-graded formative assessment, the 
instructor 

• sees the learner's initial response. A great deal of time and thought goes into 
preparation of feedback on each response. 

• must offer opportunity for rewriting in order to ensure that learners rethink the 
assignment, and 

• must grade, or at least remark, a second set of responses. 

The learner 

• sees his or her initial response, 

• sees the instructor's reply, and 

• formulates a second response in isolation, often long after discussion has taken place. 
Such a scenario can take more than a week in two-day-per week classes. 

Using the self-grading technique, the instructor 

• sees the learner's initial response, 

• sees the information the learner gleaned fi'om the discussion session, 

• gets a measure of the learner's level of comprehension fi'om his or her adherence to 
the rubric, 

• must review only one set of papers, and then only to make small adjustments in the 
learner's understanding. 

The learner 

• sees his or her initial response, 

• reflects on that response and becomes engaged, 

• formulates a second response, 

• sees the instructor's response to both learner responses, and 

• receives timely feedback on her or his thinking and self-assessment. 

The self-grading scenario can usually be accomplished in one class period. The 
quahty and the quantity of formative assessment are greatly improved. The impetus to 
think critically is placed where it belongs - with the learner. And, since the time the 
instructor spends grading papers is significantly reduced, another barrier to successful 
problem-based learning is removed. 
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SMTH122 - Graphing activity 1- The Runner 



A runner starts her workout by jogging slowly at a steady pace for ten minutes. She then 
runs fast for twenty minutes, but catches up with a friend who is a slower ruimer. She 
runs with him for fifteen minutes and then, for the final five minutes, walks to cool down. 
On the first grid below, draw a possible graph of her speed as a fimction of time. On the 
second grid, draw a possible graph of her distance traveled as a fimction of time. 

SPEED 




MINUTES 

DISTANCE TRAVELED 




MINUTES 
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Self Assessment 
Rubric#! 5 Points 

I did not do the activity. 

I tried something, but my 
answer is impossible. 

My results are possible 
but highly unlikely. 

My results are mostly reasonable 
but need improvements. 

My results are good. I can find 
no flaws in my reasoning 




0 points 

2 points 

3 points 

4 points 

5 points 
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